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All models are wrong but some are useful. 

— George E. P. Box, 
"Robustness in the strategy of 
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C« . scientific model building" (1979) 

Abstract 

It is common practice to compare the computational power of different 
^ , models of computation. For example, the recursive functions are strictly 

more powerful than the primitive recursive functions, because the latter 
are a proper subset of the former (which includes Ackermann's function). 
Side-by-side with this "containment" method of measuring power, it is 
standard to use an approach based on "simulation". For example, one 
^ says that the (untyped) lambda calculus is as powerful — computationally 

. speaking — as the partial recursive functions, because the lambda calcu- 

lus can simulate all partial recursive functions by encoding the natural 
numbers as Church numerals. 

The problem is that unbridled use of these two ways of comparing 
power allows one to show that some computational models are strictly 
, stronger than themselves! We argue that a better definition is that model 

}_( ' ^ is strictly stronger than B if A can simulate B via some encoding, 

' whereas B cannot simulate A under any encoding. We then show that 

the recursive functions are strictly stronger in this sense than the primi- 
tive recursive. We also prove that the recursive functions, partial recursive 
functions, and Turing machines are "complete", in the sense that no in- 
jective encoding can make them equivalent to any "hypercomputational" 
model. 



1 Introduction 

Our overall goal is to formalize the comparison of computational models. We 
seek a robust definition of relative power that does not itself depend on the 
notion of computability. It should allow one to compare arbitrary models over 
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arbitrary domains via a quasi-ordering that successfully captures the intuitive 
concept of computational strength. We want to be able to prove statements 
like "analogue machines are strictly more powerful than digital devices" , even 
though the two models operate over domains of different cardinalities. 

Since we are only interested here in the extensional quality of a compu- 
tational model (the set of functions that it computes), not complexity-based 
comparison or step-by-step simulation, we use the term "model" for any set of 
partial functions, and ignore all the "mechanistic" aspects. 

1.1 The Standard Comparison Method 

There are basically two standard methods, Approaches C and S below, by which 
models have been compared over the years. These two approaches have been 
used in the literature in conjunction with each other; thus, they need to work 
in harmony. That is, if models A and A' are deemed equivalent according to 
approach C, while A' is shown to be stronger than B by approach S, we expect 
that it is legitimate to infer that A is also stronger than B. 

Approach C ( Containment) . Normally, one would say that a model A is at least 
as powerful as B if all (partial) functions computed by B are also computed by 
A. If A allows more functions than B, then it is standard to claim that A is 
strictly stronger. For example, general recursion (Rec) is more powerful than 
primitive recursion (Prim) (e.g. 1111 p. 92]), and inductive Turing machines are 
more powerful than Turing machines T, p. 86]. 

Approach S (Simulation) . The above definition docs not work, however, when 
models use different data structures (representations). Instead, A is deemed 
at least as powerful as i? if A can simulate every function computable by B. 
Specifically, the simulation is obtained by requiring an injective encoding p from 
the domain of B to that of A, such that for every function g computed by B 
we have g = ° f ° p for some function / computed by A^ in which case A is 
said to be at least as powerful as B. See, for example, [S] p. 27], p. 24], or 
Hi p. 30]: 

Computability relative to a coding is the basic concept in compar- 
ing the power of computation models.. . . The computational power 
of the model is represented by the extension of the set of all func- 
tions computable according to the model. Thus, we can compare 
the power of computation models using the concept 'incorporation 
relative to some suitable coding'. 

Equivalence. To show that two models are of equivalent power by the simulation 
method, one needs to find two injections, each showing that every function 
computed by one can be simulated by the other. For example, Turing machines 
(TM), the untyped lambda calculus (A), and the partial recursive functions 
(PR) were all shown to be of equal computational power, in the seminal work 
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Figure 1: Computational Power Hierarchy 



of Church 2^, Kleene [T] and Turing [Tg. 

More Powerful. To show that model A is strictly more powerful than model 
B, one normally shows that A is at least as powerful as some model A' that 
comprises more functions than B {A' D B). (See, for example, [S].) Figure^ 
illustrates this standard conception, according to which Turing machines are 
considered strictly more powerful than primitive recursion, since TM is equiv- 
alent to Rec — by simulation, and Rec is strictly more powerful than Prim — by 
containment. 



1.2 The Problem 

Unfortunately, it turns out that these two approaches, which form the standard 
method of comparing computational power, are actually incompatible. We pro- 
vide examples in Section|21of cases in which a model A is strictly more powerful 
than B by the first approach, whereas B is at least as powerful as A by the sec- 
ond. It follows that the combination of these two standard approaches allows 
for models to be strictly stronger than themselves! 

Specifically, in Example 0] below, we describe a model that is a proper sub- 
set of the recursive functions, but can, nevertheless, simulate all of them. This 
raises the question whether it could possibly also be the case that the primitive 
recursive functions are of equivalent power to Turing machines, via some "wild" 
simulation. Could it be that the recursive functions are of equivalent computa- 
tional power to some proper superset, containing non-recursive functions? 
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1.3 The Suggested Solution 

We begin (in Definition O below) with the basic comparison notion "as powerful 
as" (^), using the simulation approach (Approach S), which naturally extends 
containment (Approach C) to models operating over different domains. (If a 
model A is as powerful as a i? by Approach C, then it is also as powerful 
as B by Approach S.) Then the "strictly more powerful" partial ordering (;^) 
is derived from the quasi-ordering ^ by saying that A y B ii A B but not 
i? ^ ^, in other words, only when there is no injection via which B can simulate 
A. 

To compare models operating over different domains requires some sort of 
mapping between the domains. A possible alternative might be to require a 
domain mapping that is not only injective but that also possesses additional 
properties, like being surjective. It turns out that bijective mappings not only 
cannot provide a sufficiently general comparison notion, but would be limited 
to permutations with bounded cycles (Theorem 

One is tempted to consider "well-defined" only those computational models 
that cannot be shown by simulation to be of equivalent power to any proper 
superset of functions. We call such a model "complete" (Definition|Sl) . The ques- 
tion then is: Are the classic models, such as Turing machines, well-defined? In 
Section |S1 we show that general recursive functions, partial recursive functions, 
and Turing machines are indeed all complete models in our sense (Theorems |S1 
[7| and^. Accordingly, we obtain a criterion by which to verify that a model 
operating over a denumerable domain is hypercomputational ( Corollary EJ. 

2 Definitions 

We consider only deterministic computational models; hence, we deal with par- 
tial functions. To simplify the development, we will assume for now that the 
domain and range of functions are identical, except that the range is extended 
with _L, representing "undefined". 

Two partial functions (/ and g) over the same domain (D) are deemed 
(semantically or extensionally) equal (and denoted simply / = 5) if they are 
defined for exactly the same elements of the domain (/(a;) = _L iff g{x) = _L for 
all X € D) and have the same value whenever they are both defined {f{x) — g{x) 
if fix) ^ _L, for all x e D). 

Definition 1 (Model of Computation) Let D be an arbitrary domain (any 
set of elements). A model of computation over D is any set of functions f : 
D ^ D U {-L}. We write dom A for the domain over which model A operates. 

Since models are sets: When A C B, for models A and B over the same 
domain, we say that A is a submodel of B and, likewise, that _B is a supermodel 
of A. Moreover, whenever we speak of A ^ B, we mean to also imply that the 
two models operate over the same domain. 
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To deal with models operating over different domains it is incumbent to 
map the domain of one model to that of the other. Let p : dom B U {_L} 
dom A U {_L} be an injective encoding. Then p o M ~ {p ° f ■ f G M} and 
Mo p = {/o p : f G M}, for any relation p and set of functions M. Additionally, 
we insist that p(jj) _L iff y = _L. 

Definition 2 (Simulation) Model A simulates model B via injection p : 
dom B dom A, denoted A>^p B, if po B C Ao p. 

This is the notion of "incorporated" used in pUi p. 29]. 

As a degenerate case, with the identity encoding l (Xn.n), we have A _B 
iff A D B. Approach C of comparison (see the introduction) uses this simple 
relation. 

Approach S is embodied in the following: 
Definition 3 (Computational Power) 

1. Model A is (computationally) at least as powerful as model B, denoted 
A ^ B , if there is an injection p such that A B . 

2. Model A is (computationally) more powerful than B, denoted A >~ B , if 
Ay B but B ^ A. 

3. Models A and B are computationally equivalent if A 'j^ B ^ A, in which 
case we write A ^ B. 

Proposition 1 The computational power relation ^ between models is a quasi- 
order. Computational equivalence ~ is an equivalence relation. 

Transitivity of ^ is because the composition of injections is an injection. 

Example 1 Turing machines (TM) simulate the recursive functions (Rec) via 
a unary representation of the natural numbers. 

Example 2 The (untyped) X-calculus (A) is equivalent to the partial recursive 
functions (PR) via Church numerals, on the one hand, and via Gddelization, 
on the other. 

Since the domain encoding p implies, by the simulation definition, a function 
mapping, we can extend p to functions and models, as follows: 

Definition 4 (Function Mappings) An encoding p : dom B dom A in- 
duces the following mappings: 



from B to A and from A to B, respectively. These extend to sets of functions 
in the usual manner: 



pig) = p°g°p ^ 

P{f) = P^^°f°P 



p{M) 
p{M) 



{p{g) -.geM} 
{p{f) -.feM}. 
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Note that any function /, such that / |"rng p— pig) trng p, simulates g via p, 
while p{f) is the only function simulated by /. The model p{M) is minimal (with 
respect to the restriction of the domain to rng p) among those that simulate M 
via p, and p{M) is the maximal model simulated by M (see Lemma Q below). 

Definition 5 (Strong Equivalence) Model A is strongly equivalent to model 
B , denoted B , if there are bijections n and r such that A B A. 

Definition 6 (Isomorpiiism) Model A is isomorphic to model B, denoted 
A=B, if there is a bijection tt such that A B ^-^-i A. 

Example 3 Lisp with only pure lists as data is isomorphic to the partial re- 
cursive functions via the Godel pairing function: 7r(nil) — 0; 7r(cons(a;, y)) = 
2'^(^)(27r(y) + 1). 

When TT is recursive, one may speak of recursively isomorphism: function / 
is recursively isomorphic to g if there is a recursive permutation tt, such that 
/ = 7r~^ o g OTT ^ pp. 52-53]. Moreover: "A property of a fc-ary relations on N 
is recursively invariant if, whenever a relation R possesses the property, so does 
g{R) for all g S G*" [HI P- 52], where G* are the recursive permutations of N. 
Thus, one may claim: "[Recursion] theory essentially studies . . . those properties 
of sets and functions which remain invariant under recursive permutations. For 
example, recursiveness, r.e.-ness, m-completeness are such invariants" [111 p. 
333]. 



3 Equivalent Submodels 

Unfortunately, the above standard definition of "simulates" (Approach S, Defi- 
nition|2Il allows for the possibility that a model is equivalent to its supermodel. 

Example 4 The set of "even" recursive functions (R2) is of equivalent power 
to the set of all recursive functions. Define: 

; is even 1 . Reel 
itherwise J J 

We have that R2 ^\n.2n Rec. 

Furthermore, it leads to situations where A y B y A ioi models A, B. For 
example, the set of "odd" recursive functions (i?i, defined analogously) is of 
equivalent power to the set of all recursive functions, by the same argument as 
above. We have that, i?i ^ Rec 3 i?2 Rec D Ri, thus Ri y R2 y Ri. Thus, 
the standard comparison method f Section II. 1(1 is ill-defined. 

It turns out that the equivalence of a model and its supermodel is possible 
even when the encoding p is a bijection and the model is closed under functional 
composition. Hence, a model might be isomorphic to a supermodel of itself. 
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Definition 7 (Narrow Permutations) A permutation tt : D ^ D is narrow 

if there is a constant k G N, such that Tr''{x) = x, for every x G D. 

Theorem 1 For every encoding p : D ^ D, there are models A and B, such 
that A C. B ;<p A, iff p is a non-narrow permutation. 

Proof. Suppose that tt is a permutation with narrow cycles bounded by k. 
Assume A "^j^ B ^ A. There is, by assumption, a function f G A, for every 
function g G B, such that g = 7r~^ o f on. Since f G B, there is, by induction, 
a function fk G A, such that g = tt"'^ o f^, o tt'^ = ff.. Therefore, B = A. 

For the other direction, we must consider three cases: (1) non-surjective 
encodings; (2) surjective encodings that are not injective; (3) bijections with no 
bound on the length of their cycles. We can prove each case by constructing 
a computational model that is strongly equivalent to a supermodel of itself via 
the given encoding. 

We provide here only a specific instance of case (3); the full proof is a 
generalization of the argument. 

Let -ff be a set of "basic functions" over N, containing all the constant 
functions (Xn.k), plus the identity, l. We present two models, A and B, that 
both contain the basic functions and are closed under function composition, 
such that the smaller one (B) simulates every function of the infinitely larger 
one (A). 

Imagine the natural numbers arranged in a triangular array: 
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Now, define the following computable functions: 

f,,j (n) = ( [ v^J + /.) ' + J mod (2 LV^J +2i + l) 
gi{n) = fifi{n) = ([Vf^J+^)^ 

If n is located on row m, then fij{n) is the number in row n + i and column j, 
while gi{n) is the first number in row n + i. 
Consider the following sets of functions: 

F = {fi,j--i,3>0} 
G = {gi:i>Q}. 

Note that F and G are disjoint, since for every i,j>Q and n > j^, /i_ij(n) < 
gi{n) < fi,j{n). 
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Define: 

B = KUF 

A = KUFUG. 

Thus, A has functions to jump anywhere in subsequent rows, while B C A is 
missing infinitely many functions gi for getting to the first position of subsequent 
rows. Since, for i + > 0, 

fi,j ° fk,i = fi+k,j , 

it follows that both F and G arc closed under composition, as is their union 
FUG, from which it follows that A and B are also closed. 

There exists a (computable) permutation tt of the naturals N, such that 
B>Z. A: 

= LV^J' + (" - LV^J' + l) mod (2 [V^J + 1) , 

mapping numbers to their successor n + 1, but wrapping around before each 
square. That is, tt has the following unbounded cycles: 

TT = {(0), (123), (45 ... 8), ...}. 

It remains to show that for all / e A = KyjFyjG, we have 7r(/) & B = KUF. 
The following can all be verified: 

7r(t) = i&K (ZB 
7r(Kfc) = K^(fc) & K C B 
T^ikj) = fij+i e -B, for i > 0, j > . 

□ 

Corollary 1 There are models isomorphic to supermodels of themselves. 

4 Comparisons 

One can categorize the maximal model that can be simulated, as follows: 
Lemma 1 For all models A and B, A'^p B iff B C p{A). 

Proof. We have B C p{A) iff for every g & B there is / G A, such that 
g = o f o p. This is the same as requiring that for every g G B there is an 
f £ A, such that po g = po p~^ ofop = fop, that is, A B. □ 
By the same argument: 
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Lemma 2 For all models A and B and bijections tt, A ^„ B iff A^ '^(B). 

Corollary 2 For all models A and injections p, A^ p{^) ■ 

Corollary 3 For all models A and bijections tt, A ~ 7r(A). 

Clearly, Tr(A) = n-\A). 

Lemma 3 For all models A and B and bijections it, A C. B implies that 'k{A) C 
7r(B) and 7r(A) C 7r(B). 

Proof. Since tt is a bijection, it follows that 7r(M) is an injection (i.e. every 
function of M is simulated by exactly one function via tt) . Therefore, ■k{B\A)C\ 
7r(A) = tt{B \A)n tt{A) = 0. □ 

Lemma 4 If A ~ B C. C , for models A,B,C, then there is a model D ^ A, 
such that C D. 

Proof. Suppose B A for bijection tt. Thus, A C ■n{B). Let D = 7r(C), for 
which we have C ~ D. Since S C C, it follows that A C t:{B) C n{C) = D. a 

Theorem 2 The primitive recursive functions, Prim, are strictly weaker than 
the recursive functions. 

Proof. Clearly, Rec Prim. So, assume, on the contrary, that Prim Rec. 
Let S £ Rec be the successor function. There is, by assumption, a function 
5" € Prim such that S' o p — p o S. Since p(0) is some constant and p{S{n)) = 
S"(p(n)), we have that p G Prim. Since p is a recursive injection, it follows that 
p~^ is partial recursive. Define the recursive function h{n) = p{imiii{p{i) > 
ack{n, n)}), where ack is Ackermann's function. Since \n.ack{n, n) grows faster 
than any primitive recursive function and h{n) > ack{n,n), it follows that 
h ^ Prim. Since rng h C rng p, it follows that t ^ p^^ o h Q Rec. Thus, there is 
a function t' G Prim, such that t'op — pot = po p^^ o h = h. We have arrived 
at a contradiction: on the one hand, <' o p g Prim, while, on the other hand, 
h ^ Prim. □ 

5 Completeness 

As shown in Section O a model can be of equivalent power to its supermodel. 
There are, however, models that are not susceptible to such an anomaly. 

Definition 8 (Complete) A model is complete if it is not of equivalent power 
to any of its supermodels. That is, A is complete if A ^ B D A implies A = B 
for all B. 

Theorem 3 

1. Isomorphism of models implies their strong equivalence. 

2. Strong equivalence of complete models implies their isomorphism. 
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Proof. The first statement is trivial. For the second, assume A B A for 
bijections tt, t. If ■k{A) C B, then, by Lemma^J T{n{A)) C A, which contradicts 
the completeness of A. Thus S = 7r(A), and therefore, ^ = tt~^{B). □ 

Lemma 5 // model A is complete and A B A, for model B, injection p 
and bijection n, then A and B are strongly equivalent models. 

Proof. Suppose A is complete, and A^p B A for injection p and bijection 
TT. It follows that 7r(5) = A' ^ A. Thus, A>Zp B A' ^ A. Therefore, from 
the completeness of A, it follows that A' = A. Hence, A' B, and A and B 
are strongly equivalent models. □ 

Theorem A If A and B are strongly equivalent models, then A is complete iff 
B is. 

Proof. Suppose that A is complete and A :^ B C C. By LemmaQ] C :^ D D A 
for some D. Were B >^ C, then A o:^ B C ~ D, contradicting the completeness 
of A. Hence, B is also complete. □ 

Theorem 5 // model A is complete and A :^ B C. C , for models B, C, then 
C> A. 

Proof. If v4 ~ B C C, then C >z B > A. And, by the previous theorem, if A 
is complete, then so is B; hence B and also A^C . Hence, C > A. □ 
We turn now to specific computational models. 

Definition 9 (Hypercomputational Model) Model M is hypercomputa- 
tional if there is an injection p, such that p{M) 13 Rec. 

Theorem 6 The recursive functions Rec are complete. That is, they cannot 
simulate any hypercomputational model. 

Proof. Assume Rec M D Rec and let S £ M be the successor function. 
Analogously to the proof of Theorem [3 p £ Rec and p~^ £ PR. For every 
/ € M, there is an /' e Rec, such that / = p~^ ° f ° P\ thus / G PR. Actually, 
/ is total, since rng (/' o p) = rng {p o f) <Z rng p. Therefore, M = Rec. □ 
By the same token: 

Theorem 7 The partial recursive functions PR are complete. 

Corollary 4 The general recursive functions (Rec) and partial recursive func- 
tions (PR) are not strongly equivalent to any of their submodels or supermodels. 
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Proof. Non-equivalence to supermodels is just Theorems El and [7| Non- 
equivalence to submodels follows from Lemma |31 □ 

As a corollary of Theorems |S1 and [HI we obtain a criterion for hypercompu- 
t at ion: 

Corollary 5 A model M , operating over a denumerable domain, is hypercom- 
putational if there is any bijection under which a proper subset of M simulates 
Rec. 

This justifies the use of the standard comparison method (Section ll.l|l in 
the particular case of the recursive functions. 

Theorem 8 Turing machines, TM, and the recursive functions, Rec, are 
strongly equivalent. 

Proof. Since Rec is complete, it is sufficient, by Lemma|21 to show that Rec ^ 
TM Rec, for some bijection tt. Since it is well-known that Rec ^ TM via 
Godelization (e.g. 6, pp. 208-109]), it remains to show that TM Rec, for 
some bijection tt. Define (as in 6, p. 131]) the bijection tt : N ^ {0, 1}*, by 



For example, 7r(0, 1, 2, 3, 4, 5, 6, 7, . . .) is e, 0, 1, 00, 01, 10, 11, 000, . . .. 

TM >3^ RAM {Random Access Machine), by pp. 131-133]; RAM D CM 
(Counter Machine), by W pp. 116-118]; and CM Rec by pp. 207-208]. 
We have that Rec >: TM >^ RAM CM >z, Rec, thus TM and Rec are 
strongly equivalent. □ 

Note that the exact definitions of RAM and CM are of no importance, as 
they are only intermediates for Rec > TM RAM CM Rec. 

Theorem 9 Turing machines, TM, are complete. 

Proof. By Theorem |H1 TM and Rec are strongly equivalent. Since Rec is 
complete, it follows, by Theorem 0] that TM is complete. □ 

6 Discussion 

There are various directions in which one can extend the work described above: 

Inductive Domains. The completeness of the (general and partial) recursive 
functions is due to several properties, among which is the inclusion of a suc- 
cessor function (Theorem EJ. The results herein can be extended to show that 




otherwise 
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computational models operating over other inductively-defined domains are also 
complete. 



Intensional Properties of Completeness. Intuitively, a properly defined compu- 
tational model should be complete. What is, however, "properly defined"? One 
can look for the intensional properties of a model that guarantee completeness. 
That is, what internal definitions that constitute a model (e.g. a finite set of 
instructions, over a finite alphabet, . . . ) guarantee completeness. 

Different Domain and Range. The simulation definition (Definition[2Jl naturally 
extends to models M : D'' — > D with multiple inputs, by using the same 
encoding p for each input component. See, for example, |1(JI p. 29]. 

A more general definition is required for models with distinct input and 
output domains. This can be problematic as the following example illustrates: 

Example 5 Let RE be the recursively enumerable sets of naturals. We define 
infinitely many non-r.e. partial predicates {hi}, which can be simulated by RE. 
Let 



h{n) = 
hi{n) = 



program n halts uniformly 

1 otherwise 

n<i\J h{n) = 
_L otherwise . 



We have that RE RE U {hi}, where 



p{n) — 2n + h{n) 

[n/2j < i V n mod 2 = 
_L otherwise 



Kin) = 
Pif) = 

Without loss of generality, we are supposing that p(0) — h{0) = 0. 



/(K2J) /gre 
Kin) f = h,. 



Firm comparison. Comparison by an injective mapping between domains might 
be too permissive, as shown in Example |S1 above. Accordingly, one may add 
other constraints on top of the mapping. For example, adding the requirement 
that the "stronger" model can distinguish the range of the mapping. That is, 
requiring a total function in the "stronger" model, whose range is exactly the 
range of the comparison mapping. 

Multivalued Representations. It may be useful to allow several encodings of the 
same element, as long as there are no two elements sharing one representation, 
something injective encodings disallow. Consider, for example, representing 
rationals as strings, where "1/2", "2/4", "3/6", could encode the same 
number. See, for example, p. 13]. To extend the notion of computational 
power (Definition to handle multivalued representations, we would say that 
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model A }^ B ii there is a partial surjective function 77 : dom A — > dom B 
iviy) = -L iff 2/ = -L), such that there is a function f G A for every function 
g G B, with 'q{f{x)) = g{r]{x)) for every x £ dom r/. This follows along the lines 
suggested in |13l p. 16]. The corresponding definitions and results need to be 
extended accordingly. 

Different Cardinalities. It may sometimes be unreasonable to insist that the 
encoding be injective, since the domain may have elements that are distinct, but 
virtually indistinguishable by the programs. For example, a model may operate 
over the reals, but treat all numbers : n + 1) as representations of rt e N. 

Effectivity. A different approach to comparing models over different domains 
is to require some manner of effectiveness of the encoding; see 0] p. 21] and |S1 
p. 290], for example. There are basically two approaches: 

1. One can demand an informal effectiveness: "The coding is chosen so that 
it is itself given by an informal algorithm in the unrestricted sense" [S] p. 
27]. 

2. One can require effectiveness of the encoding function via a specific model, 
usually Turing machines: "The Turing-machine characterization is espe- 
cially convenient for this purpose. It requires only that the expressions of 
the wider classes be expressible as finite strings in a fixed finite alphabet 
of basic symbols" ^, p. 28]. 

Effectivity is a useful notion; however, it is unsuitable for our purposes. The 
first, informal approach is too vague, while the second can add computational 
power when dealing with subrccursive models and is inappropriate when dealing 
with non-recursive models. 

Nondeterministic Models. The computational models we have investigated are 
deterministic (Definition ^| . The corresponding definitions and results should 
be extended to nondeterministic models, as well. 
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